jjfe MOSER PATTERSON SHERIDAT^^F 



05/25/04 20:01 FAX 732 530 108 MOSER PATTERSON SHERIDAN^FpTO ©007 



PATENT 
Serial No.: 09/769,599 
Atty.Dkt. No. SAR 13896 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

LISTING OF CLAIMS _ 

1 . (Currently amended) A method for performing motion analysis on a sequence of 
images, where said sequence of images captures a plurality of objects each moving 
along a trajectory in an imaged area, said method comprising: 

extracting motion information for each of said plurality of objects contained in said 
sequence of images; and 

determining spatial patterns from said extracted motion information , where said 
determining step comprises determining a route comprising a trajectory of a first object 
having the same trajectory of at least one other object . 



2. (Canceled) 

3. (Currently amended) The method of claim [[2Q 1 wherein said determining of said 
route comprises: 

determining whether said trajectory of a second object is within a threshold 
distance said trajectory of said first object; and 

including, if said trajectory of said second object is within the threshold distance, 
said trajectory of said second object in said route. 



4. (Original) The method of claim 1 wherein said determining of spatial patterns 
comprises: 

determining a source point and a destination point from said trajectory of said 
plurality of objects. 

5. (Original) The method of claim 4 wherein said determining said source point 
comprises: 

determining whether a number of trajectories originating from a location is greater 

than a threshold number; and 

identifying, if the number of trajectories originating from the location is greater than 

Page 2 

276271JI 



7/16 * RCVD AT 5/25/2004 8:53:18 PM [Eastern Daylight Time] • 8VR:U8PTO-EFXRF-1/2 * DNI8:8729308 • CSID:732 530 0808 • DURATION (mm-*s>:08-30 



05/25/04 20:01 F AX 732 530 W8 MOSER PATTERSON SHERIDAI^FPTO g)008 



A^^F 



PATENT 

Serial No.: 09/769.599 
Atty. Dkt No. SAR 13896 

the threshold number, the location as said source point. 

6. (Original) The method of claim 4 wherein said determining said destination point 
comprises: 

determining whether a number of trajectories ending at a location is greater than a 
threshold number; and 

identifying, if the number of trajectories ending at the location is greater than the 
threshold number, the location as said destination point. 

7. (Original) The method of claim 4 wherein said source point and said 
destination point are determined using a clustering process. 

8. (Original) The method of claim 1 further comprising: 

determining spatio-temporal patterns from said determined spatial patterns along 
a time dimension. 




9. (Original) The method of claim 8 wherein said determining of spatio-temporal 
patterns comprises: 



determining a busy time for said route, where the busy time represents a time 
when a number of trajectories for said plurality of objects along said route is greater 
than a threshold number. 

10. (Currently amended) The method of claim 8 wherein said determining of spatio- 
temporal patterns comprises: 

determining a periodicity of at least one trajectory in said a route. 



1 1 . (Currently amended) Tho m e thod of claim 10 A method for performing motion 
analysis on a sequence of images, where said sequence of Images captures a plurality 
of objects each moving along a trajectory in an imaged area, said method comprising: 

extracting motion information for each of said plurality of objects contained in said 
sequence of images: 
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determining spatial patterns from said extracted motion information; 
determining spatio-temporal patterns from said determine d spatial patterns along 

a time dimension; 

wherein said determining of spatio-temporal patte rns comprises: 

determining a periodicity of at least one trajectory in a route, w herein said 
determining the periodicity comprises: 

selecting a time scale; and 

determining whether a first occurrence of an event along said route 
and time scale is periodic with subsequent occurrences of said event along 
the same route and time scale. 

12. (Original) The method of claim 1 1 wherein said event comprises said trajectory of 
said first object. 




1 3. (Original) The method of claim 1 1 wherein said event comprises a number of said 
trajectories greater than a threshold value. 



14. (Original) The method of claim 1 further comprising: 

determining a first route comprising a trajectory common to a first set of at least 
two objects; 

determining a second route comprising a trajectory common to a second set of at 
least two objects; and 

determining whether said trajectory in said first route is time correlated with said 
trajectory In said second route. 

15. (Original) A method for displaying motion information of objects contained in a 
sequence of images, the method comprising: 

performing a query on a plurality of spatial patterns stored in a database, where 
each of said plurality of spatial patterns comprises a route determined from a trajectory 
common to at least two objects moving in an imaged area captured in said sequence of 
images; 
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determining a trajectory satisfying at least one constraint specified in said query; 

and 

displaying said determined trajectory on a user interface. 

16. (Original) A system for performing motion analysis on a sequence of images, the 
apparatus comprising: 

a motion extraction system for receiving said sequence of images capturing a 
plurality of objects each moving along a trajectory, and extracting motion information for 
each of said plurality of objects over said sequence of images; and 

a motion mining system for determining spatial patterns from said extracted 
motion information, where said spatial patterns comprise a route determined from said 
trajectory common to at least two objects. 

17. (Original) The system of claim 16 further comprising a video source for capturing 
said plurality of objects in an imaged area and transmitting video containing said 
captured plurality of objects to said motion extraction system. 

1 8. (Original) The system of claim 1 6 further comprising: 

a database for storing said spatial patterns determined from said motion mining 
system; and 

a server computer for retrieving said trajectory satisfying at least one constraint 
specified in a query. 

19. (Original) The system of claim 16 wherein said spatial patterns comprise a route 
having a trajectory of a first object that is the same as the trajectory of at least one other 
object. 




20. (Original) The system of claim 16 wherein said spatial patterns comprise a 
source point and a destination point for said trajectories of said plurality of objects. 

21 . (Original) The system of claim 16 wherein said motion mining system determines 
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spatio-temporal patterns from said spatial patterns along a time dimension. 

22. (Original) An apparatus for performing picture analysis, the apparatus comprising: 
a memory for storing a motion mining program; 

an interface for receiving motion information containing trajectory information for a 
plurality of objects captured in an image sequence; 

a processor, upon executing said motion mining program retrieved from said 
memory, determines spatial patterns from the received motion information. 

23. (Original) The apparatus of claim 22 wherein said spatial patterns comprise a 
route having a trajectory of a first object that is the same as the trajectory of at least one 
other object. 

24. (Original) The apparatus of claim 22 wherein said spatial patterns comprise a 
source point and a destination point for said trajectories of said plurality of objects. 

25. (Original) The apparatus of claim 22 wherein said processor determines spatio- 
temporal patterns from said spatial patterns along a time dimension. 
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